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Abstract 

We consider stochastic discrete event dynamic systems that have 
time evolution represented with two-dimensional state vectors through 
a vector equation that is linear in terms of an idempotent semiring. 
The state transitions are governed by second-order random matrices 
that are assumed to be independent and identically distributed. The 
problem of interest is to evaluate the mean growth rate of state vector, 
which is also referred to as the mean cycle time of the system, under 
various assumptions on the matrix entries. 

We give an overview of early results including a solution for sys- 
tems determined by matrices with independent entries having a com- 
mon exponential distribution. It is shown how to extend the result to 
the cases when the entries have different exponential distributions and 
when some of the entries are replaced by zero. Finally, the mean cy- 
cle time is calculated for systems with matrices that have one random 
entry, whereas the other entries in the matrices can be arbitrary non- 
negative and zero constants. The random entry is always assumed to 
have exponential distribution except for one case of a matrix with zero 
row when the particular form of the matrix makes it possible to obtain 
a solution that does not rely on exponential distribution assumptions. 

Key- Words: discrete event dynamic system, mean cycle time, idem- 
potent semiring, random matrix, convergence in distribution. 



1 Introduction 

Many actual systems in engineering, manufacturing, management, and other 
areas can be modeled as stochastic discrete event dynamic systems. The 
dynamics of the systems is normally described by recurrent equations for a 
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set of state variables representing the occurrence time of system events. In 
some cases, the state evolution of the system can also be written in vector 
form with a state transition matrix through a vector equation that is linear 
in the sense of an idempotent semiring [H El [3l H] . As an example, one can 
consider the G/G/1 queue and related representation in the form of Lindley 
recursions (see, e.g. [5]). 

In the analysis of system performance, one is often interested in evalu- 
ating the mean growth rate of the system state vector, which presents the 
mean time of one system operation cycle. However, exact calculation of the 
mean cycle time can be a rather cumbersome problem even for quite simple 
systems. Most of the known results are limited to systems with second-order 
state transition matrices having independent random entries. 

In this paper we give an overview of existing solutions and present new 
results for the problem. We start with motivating examples of calculating 
the mean cycle time drawn from manufacturing and telecommunications. 
Early results from [6l [3 1^ including solutions for second-order matrices 
with independent and identically distributed (i.i.d.) entries are outlined. For 
exponential, continuous uniform, Bernoulli, geometric, or discrete uniform 
distributions, the solutions are given as rational functions of distribution 
parameters. 

To get solutions for other systems with second-order matrices, we im- 
plement an approach based on constructing and analyzing a sequence of 
one-dimensional distributions. The mean cycle time is calculated as the 
mean of a random variable (r.v.) determined by the limiting distribution 
of the sequence. Specifically, the case of a matrix where the entries have 
exponential distributions with arbitrary parameters is considered. We de- 
scribe a computational technique [9j that actually reduces the problem to 
the solution of an appropriate set of linear algebraic equations. 

Furthermore, systems with random matrices that can have some constant 
entries are examined. Both recent results for matrices with zero entries 
[1U\ [TT] and new results for matrices that can have arbitrary nonnegative 
constant entries are presented. The new results include solutions for systems 
with second-order matrices that have one random entry, whereas the other 
entries can be arbitrary nonnegative and zero constants. The random entry 
is always assumed to have exponential distribution except for one case when 
the particular form of the matrix makes it possible to obtain a solution that 
does not rely on exponential distribution assumptions. 

2 Preliminary Observations 
2.1 Motivating Examples 

We start with example systems drawn from manufacturing and telecommu- 
nications. Other related examples can be found in [6l[8l[3]. 
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2.1.1 Manufacturing 



Consider a manufacturing system that consists of two production centers 
A and B. Each center produces its output based on use of an output 
from the other center. The operation of each center as well as of the entire 
system consists in a sequence of production cycles. Every cycle involves 
simultaneous production of a new output and transportation of the output 
by the previous cycle. A center completes its current cycle as soon as it 
finishes production of the current output and an output from the other 
center arrives. A current production cycle of the system comes to the end 
and the next cycle is initiated as soon as both centers A and B complete 
their respective production cycles. 

Suppose that at the initial time, each center has its output available 
for delivery. Given random production and transportation time for both 
centers, one is often interested in evaluating the mean time of production 
cycle as the number of cycles goes to infinity. The system throughput defined 
as the inverse of the mean cycle time can be another performance measure 
of interest. 

For every cycle fc = 1, 2, . . . we introduce the following notation. Let ccfc 
and 5k be r.v.'s that represent the production time at respective centers A 
and B, and let /3k and jk be r.v.'s that represent the transportation time 
from B to A and from A to B . By x{k) and y{k) we denote the cycle 
completion epochs at centers A and B. 

With the condition that x(0) = y{0) = 0, the dynamics of the system is 
naturally represented by two equations 



provided that the limit on the right exists. 
2.1.2 Telecommunications 

Suppose that there is a system of two work stations A and B which ex- 
change messages over a communication network. Each station generates 
and sends messages in response to messages received from the other station. 
If a message is sent from a station, it immediately enters the network and 
then goes from one intermediate node to another until it arrives at the other 
station. 

The operation of each station and of the entire system consists in a 
sequence of communication sessions. A new session at a station begins 



x{k) = max(a;(A; — 1) + a^, y{k — 1) + Pk) 
y{k) = max(a;(A; - 1) + 7fe> y{k - 1) + 5k). 



(1) 



The mean cycle time for the system is given by 



A = lim — max(x 




(2) 
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with generation of a new message and completes by sending the message 
to the other station. Once the message is generated, it is sent from the 
station as soon as a message from the other station arrives. A current 
communication session of the system starts when both nodes A and B 
complete their previous sessions, and lasts until they complete the current 
sessions. 

For every session k = 1,2, ... we denote by x{k) and y{k) the session 
completion epochs for respective stations A and B . Let ak and 5k be the 
random message generation time for stations A and B , and fS^ and 7^ be 
the random message transmission time from B to A and from A to B . 

Given the r.v.'s a^, /3fc, 7^, and 5k for all k = 1,2, . . . we consider the 
problem of evaluating the mean communication session time which one can 
take as a natural performance measure for the system. As it is easy to see, 
the dynamic equations for the system have the same form as ([1]). Moreover, 
the mean communication session time can be given by ([2]) as well. 

2.2 Problem Representation and Preliminary Analysis 

Consider an idempotent semiring with two operations, maximum as semir- 
ing addition, and arithmetic addition as semiring multiplication. Define a 
system state transition matrix for every k = 1,2, . . . as 




We suppose that each of the sequences {ak} , {/3fc}, {7fc}, and {5k} 
involves either i.i.d. r.v.'s or nonnegative constants, and that the sequences 
are independent themselves. 

Furthermore, we introduce a state vector z{k) as follows 

Scalar equations ([1]) can now be replaced with an equation 

z{k) = A{k)z{k - 1), (4) 

where matrix- vector multiplication is thought of in the sense of addition and 
multiplication in the semiring. 

With the norm || • || defined as the maximum entry of a vector, we can 
rewrite the limit in ([2]) to represent the problem of interest as that of finding 

A= lim ||;^(A:)f/^ (5) 

fc— )-CXD 

where A can generally be interpreted as the mean growth rate of state vector 
in system (jH). 
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Consider a stochastic system governed by equation ^ and assume that 
the random entries in matrix ^ have finite means. It is not difficult to 
verify (see e.g. [121 Ej) that under this assumption, the Hmit at ([5]) exists 
with probability one. Moreover, in this case, it holds that 

A= lim E\\z{k)\\^/\ 

k^oo 

or, in ordinary notation, that 

A= lim —Emax.{x{k),y{k)). 

k^oo k 

Note that the above vector representation, among other benefits, enables 
one to enhance the analysis of the system by using models and methods of 
idempotent algebra (see e.g., |5]). Specifically, the range of particular cases 
to analyze can be reduced on the basis of the following observations. First, 
it is not difficult to see from and ([5]) that both systems, with a matrix 
A{k) and its transpose A^i^k), have the same value of A. Moreover, the 
mean cycle time is invariant to simultaneous row and column permutations 
in A{k) . Finally, any superposition of the above transformations also leaves 
A unchanged. 



2.3 Previous Results 

The problem of evaluating the mean cycle time may involve cumbersome 
computations even for quite simple systems. Many known results are ob- 
tained for systems with second-order matrices with i.i.d. random entries 

mum- 

A system with a matrix where all entries are exponentially distributed 
with parameter fi is examined in [71 E]. A somewhat too complicated 
solution based on the theory of Markov chains in [6J leads to the result 
A = 407/(228//). 

For the particular case /i = 1, this result is obtained in [7\ with a less 
rigorous approach that actually reduces the problem to the solution of an 
integral equation. 

Furthermore, the technique developed in [6] is extended to get the so- 
lution A = 0.719 when all entries of the matrix have a continuous uniform 
distribution on [0,1]. 

Another rather sophisticated approach to the problem with second-order 
matrices is proposed in [8j. The approach considers a sequence of two- 
dimensional distributions of the system state vector and examines the con- 
vergence of the sequence by applying the Laplace transform of the distribu- 
tions. It is shown that for a system with a matrix where the diagonal and 
off-diagonal entries are exponentially distributed with respective parameters 
H and v , the solution takes the form 

A = P{fi,iy)/Q{n,u), 
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where 



u) = 160^^° + 1776/iV + 8220/i^z^2 + 21378/i'^i/^ 
+ + 41566^^1^^ + 35595/z^^ 

+ 21378^^1/'^ + 8220^2;^^ + 1776^z^^ + 160i/^°, 
Q(//, z^) = 16/ii/(^ + i^)(8^^ + 80/z^ + 321^^zy2 + GdOfi^u^ 
+ 880/z^^ + 690^^1^^ + 321/^^2^^ + 80/ii/^ + 8z^^). 

For a system with a symmetric matrix having both diagonal entries ex- 
ponentially distributed with parameter fi and off-diagonal entries equal to 
zero, the solution is A = 5/(4^) . 

We conclude with an overview of results for discrete distributions. In 
[71 [6], the case of matrices of order n = 2,3 is examined when the en- 
tries have the discrete uniform distribution on 0,1, ... ,m. The evolution of 
the differences between components of the state vector is represented as a 
Markov chain, whereas the mean cycle time is evaluated from the station- 
ary probabilities of the chain. The results obtained can be summarized as 
follows 

n = 2, m=l, A = 6/7 0.857, 

n = 2, m = 2, A = 0.803, 

n = 2, m— >oo, A —> 0.719, 

n = 3, m = 1, A = 0.979. 

The above approach is further developed in [8] where a technique is 
implemented based on recursive computation of joint generating function of 
the state vector. In the case of a matrix with i.i.d. entries having Bernoulli 
distribution with parameter p, the solution is given by 

. (l + 2p)(l-p)4 

1 - 2p(l -p)(l - 3p + p2)- 

Finally, for the system where the entries of the matrix are geometrically 
distributed with parameter p, it holds that 

A = N{p)/D{p), 

where 

N{p)=p{4+18p+ 50p^ + 99p^ + 1 75p^ + 244p^ + 289p^ 

+273/ +218/ + 137/ + 77/° +32/^ + 1 1/^ +p^^), 

D{p) = (l-/(l+/(l+p+/)(l+6p+8/+20/ 
+25p'^+ 32p^ + 25p^ + 20p^ + 8^*^ + +p^°) . 
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3 An Overview of Recent Results 

This section offers solutions that generahze results given in [71 El [8] for sys- 
tems that have second-order matrices with exponentially distributed entries. 
We start with a solution developed in [9] for the case of pure random ma- 
trices having only random entries with different exponential distributions. 

Furthermore, we consider results obtained in \10i illj for matrices with 
some nonrandom entries that are equal to zero. The reduced number of 
random entries in the matrices allows one to simplify the evaluation of the 
mean cycle time and usually gives quite compact results. 



3.1 The System With a Pure Random Matrix 

Consider a system with the state transition matrix 




where Ofc , , 7^ , and 6k are assumed to have exponential distributions 
with respective parameters // , v , a , and r . 

To get the mean cycle time, a computational technique proposed in [9] 
reduces the problem to the solution of a system of linear equations, accom- 
panied by the evaluation of a linear functional of the solution. The technique 
leans upon construction and examination of a sequence of probability den- 
sity functions. It is shown that there is a one-to-one correspondence between 
the sequence of density functions and a sequence of certain vectors in a vec- 
tor space. The correspondence is then exploited to provide for the result in 
terms of algebraic computations. 

Based on the above technique, the mean cycle time is evaluated as fol- 
lows. First we introduce the vectors 

cji = (wio, a;ii,a;i2,a;i3)'^, ^2 = (^20, (^21, (^22, '^23)'^- 
Then we put 

^ / ^1 \ / UiVu U1V12 \ 

V ^2 y ' V t^2V^2i U2V22 J ' 

where the matrices Ui and U2 are defined as 





1 


1 


1 


\ 




A* 


1 








fl+U 


2 


fj,+2i/ 






fJ- 


V 








fjL+T 


V-\-T 


fl+U+T 




v 


M 


V 


fl+l/ 


/ 


H+V+T 


2U+T 


fl+2u+T 


/ 


1 


1 


1 


\ 




cr 


T 








fi+a 


/i+T 


fi+a-\-T 








T 


f7+r 






2 


CT+T 


20-+T 
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Furthermore, the matrices Fn and Vu are defined as 



11 







V 
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whereas V21 and V22 take the form 

/ M fJ^ 



V 
/ 



' (M+r)(M+<T+r) 
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ua 

{u+T){iy+cr+T) 
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{fj,+u+T) (fi+u+a+r) 
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(/i+t7)(/i+(7+T) \ 



(/U+i/+<T)(/i+I/+(T+T) / 
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Suppose the vector uj is the solution of the system 

(/ - W)uj = 0, 

Wio + iO20 = 1, 

where / represents the identity matrix, is zero vector. 
The mean cycle time is then given by 



where qi and 92 are vectors such that 
/ 

Qi = 



licr{fj.+2i/+a) 



V 



Q2 



/jo-(/i+o-+2t) 
T{fi+T){a+T){p.+a+T) 

{v+T)(^H+V+T){u+<7+T){n+V+a+T) ) 

ut{u+t) 
vt(2^+v-\-t) 



ut(u+2i7+t) 



ut(2ij,+u+2(t+t) . 
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3.2 Systems With Matrices With Zero Entries 



Suppose the time to perform certain operations in a system (e.g., produc- 
tion of output at a center or transmission of messages between stations) is 
sufficiently short as compared to that of the other operations. Under this 
assumption, one can usually set the duration of the operations equal to zero 
with negligible loss of accuracy, and then consider equation with a matrix 
that includes one or more zero entries. 

The solution method in this case is based on construction of a sequence 
of probability distribution functions. The convergence of the sequence is ex- 
amined and the limiting distribution is derived as the solution of an integral 
equation. The mean cycle time is then evaluated as the expected value of 
a r.v. determined through the limiting distribution function. The results 
obtained are as follows. 

3.2.1 Matrices With Zero Off-Diagonal Entries 

The system state transition matrix together with the related result take the 
form 

With T = fi = 1 we have the mean cycle time A = 1.25 which coincides 
with that in [8]. 



3.2.2 Matrices With Zero Diagonal 

In this case, the matrix and the mean cycle time are represented as 
Aik)=( i'), ,_4-^ + 7.a + 4a^ 



7fc J Qi/a{u + a) 

3.2.3 Matrices With Zero Row or Column 

Provided that the second row in the matrix has only zero entries, we arrive 
at 



Considering that A is invariant to transposition of the matrix, we imme- 
diately get the solution when the entries of the second column are zero 
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3.2.4 Matrices With One Zero Diagonal Entry 

Consider a system with the state transition matrix 

m ^ ( * ) . 

Although evaluation of the mean cycle time for this system in the general 
case leads to rather cumbersome algebraic manipulations, there are two main 
particular cases that offer results in a relatively compact form. Under the 
condition that a = fi, we have 

+ 238/iV + 495^^;^^ + + 326fiiy^ + 68u^ 

2fiv{36n^ + Uln^u + 215/x2z/2 + 130/xz/3 + 28iy^) 

Provided that a = v, the mean cycle time is given by 

A = P{ii,u)/Q{ix,v), 

where 

P(/x, u) = 15/ + 152^^1^ + 624/^^1/2 + 1382// zy''^ + 1838^1^^ 
+ 1592/^3 z/^ + ^Tin^v^ + 'iMiiv'^ + 64/^^ 

Q(/x, v) = nv{iJL + vf{12iJ' + 97/i^i^ + 28Qi/v'^ + mij/v^ 
+ 256/xiy^ + 64i/5). 

3.2.5 Matrices With One Zero Off-Diagonal Entry 

Suppose that there is a system with a state transition matrix defined as 

Consider two particular cases. With the condition u = n, we have 

A = P(//,r)/Q(//,r), 

where 

P(/x, r) = 288/x^ + 1048/r + 1936h^t^ + 2688/xV^ 

+ 3012/r^ + 2226/xV^ + 941/xV^ + 204/xt^ + 17r^, 

Q(/x,r) = 2/xT(144/ + 524/iV + 968/xV^ + 1200/xV3 
+ 910/x V + 387/xV^ + 84/xr^ + 7r^). 
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Provided that t = fj,, the solution takes the form 



\ = P{n,l^)/Q{^^,u) 



where 



P(/x, ly) = 256/x^° + + 8044/1^^ + 19355/i/^ 

+ + + 28709/i^^ 

+ 14854/x^z/^ + 4912/x2i/^ + 944/xz/9 + 80i/^°, 
z/) = 2/xz/(/x + z/)(192/ + 1344/1/ + 4047/x^i/2 

+ 6770/i^z/^ + 6799/z/'' + 4216/x^i/^ + 1600/i^z/^ 
+ 344/xz/^ + 32i/^). 

4 Results for Matrices with Arbitrary Constant 
Entries 

Now we present new results that extend some of the solutions in the previous 
section to the case of matrices with arbitrary nonnegative constants in place 

of one or more entries. The results allows one to take account of various 
possible settings for activity times in actual systems from a random time to 
constant and zero time. 

4.1 Matrices With One Random Entry 

We examine systems with matrices that have one random entry, whereas the 
other entries can be arbitrary nonnegative and zero constants. To evaluate 
the mean cycle time, we apply the same technique as that developed for 
matrices with zero entries and outlined in the previous section. 

The random entry in system matrices is always assumed to have expo- 
nential distribution except for one case of a matrix with zero row. In the 
later case, the particular form of the matrix enables one to obtain a solution 
that does not rely on exponential distribution assumptions. 

4.1.1 Matrices With Zero Off-Diagonal Entries 

We start with a system that has a matrix 



where c is a nonnegative constant, is a r.v. that has exponential distri- 
bution with parameter /j, . 
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The solution procedure that is described in detail in Append 
the result 

2g— 3/ic 

^ — g _i 

Figures [T] and [5] show graphs of A as functions of c and /i . 




12 3c 

Figure 1: Graphs of A as a function of c. 
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Figure 2: Graphs of A as a function of /x. 



4.1.2 Matrices With Zero Row or Column 

With similar computations as above, we get the solutions 



and 



m 

Aik) 



c 



c 

Ik 



A = c + 



A = c + 



2e- 



1/(2 + 6-2^'=)' 

o-(2 + e-2^c)' 
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Graphical representation of A with respect to c and fi is of much the 
same shape as that of respective graphs depicted in Figures [T] and [2j 

Now we present a system that admits a solution under more fairly con- 
ditions and in a quite general form. Consider a system with a matrix 



ak c 




and assume c to be a nonnegative constant and ak to be a nonnegative r.v. 
that has a distribution function F{t) with finite mean a. 

As it is shown in Appendix lA. 21 the mean cycle time for the system is 
given by 

F(t)F(c-t)(l-F(t)) 



A = a + 



-dt. 



/o l-F(t)F(c-t) 
Specifically, in the case of the exponential distribution function 

F{t) = max(0,l - e"^*), 

we have a = l/fj,. Calculation of the integral gives 



c e~'"' 3 arctan V4e/^'= - 1 

A = - + — + ; 

2 /i ^^4eMc _ 1 



A graphical illustration is given in Figures [3] and [H 




1234c 

Figure 3: Graphs of A as a function of c. 



4.1.3 Matrices With Three Constant Entries 

For a system with the symmetric matrix 

\ c c 
13 




c = 2 



1 2 3 4 // 

Figure 4: Graphs of A as a function of fi. 



a solution obtained in |13j takes the form 

2e-^^ 

A = c + 
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A Solution Procedures 

A.l A Matrix With Zero Off-Diagonal Entries 

We describe evaluation of the mean cycle time for system ^ with the matrix 

°). 

where c is a nonnegative constant, is a r.v. with distribution function 

Fait) =max(0,l -e-'^*). 
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Note that equations ([T|) can now be written as 

x{k) = ma-x.{x{k — 1) + ak,y{k — 1)), 
y{k) = max(x(k — l),y{k — 1) + c). 

With new variables 

X{k) = x{k)-x{k-l), 
Y{k) = y{k)-x{k), 

we arrive at the equations 

X{k) = max(afc,y(A; - 1)), 

Y{k) = max(0, Y{k - 1) + c) - max(afc, Y{k - 1)). 
It is not difficult to see that X{k) > 0, Y{k) < c, and 

x{k)=X{l) + ---+X{k). 
Now the mean cycle time can be represented in the form 

A= lim — E max(x(/c), y(fc)) 

k^oo k 



= lim iEmax(0,y(A;)) + lim iVEX(A;) 

i=l 

1 ^ 

= lim - Y'EX(k). 

fc->oo k ^ 

i=l 

Consider the distribution functions 

<^k{t) = P{X{k) < t}, ^k{t) = P{Y{k) < t}, 
and note that 

= P{max(afe,y(fc - 1)) < t} = Fa{t)^ k-i{t) ■ 
From the law of total probability it follows that 

/•oo 

^k{t)= P{Y{k) <t\ak = u}dFo,iu). 
Jo 

Evaluation of the conditional probability gives 

P{Y{k) < t\ak = u} 

= P{max(0, Y{k - 1) + c) - max(n, Y{k - 1)) < t} 

0, if n < —t, t < c; 
^fc_i(n — c + t), if n > —t, t < c; 
1-^k-ii-t), ifu<-t,t>c; 

1, if u > —t, t > c. 
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After appropriate substitutions, we arrive at the recurrence equation 

' oo 

//e'^* / - c)e-''''du, if i < 0; 



H J *fe-i(n - c + t)e-^''du, if < t < c; 



.1, 



if t > c. 



Let us investigate the convergence of the sequences {^'fe} and {^k}- We 
introduce the notation 



ak = 1^ 



^0 



e-^'^^du. 



With C = e f^"^ , the recurrence equation takes the form 



'C(afe_i + 6fc_i + C)e'^*, ifi<0; 
C i^ak-i + bk-i + C) e'^*, if < t < c; 
1, ift>c. 



It is clear that there is a one-to-one correspondence between the sequence 

of functions {^k} and the sequence of vectors {{dk^bk)} ■ 

The last equation together with the definitions of and bk give the 
recurrences 

Uk = ficCuk-i + /icCbk-i + ncC'^, 
bk = —^ak-i + ncCbk-i + ncC . 
The iteration matrix of the recurrences has eigenvalues given by 

Since < xe~^ < for all a; > 0, both eigenvalues have absolute 
values less than one. Therefore, the recurrences produce iterations that 
converge to a limiting vector (a, b) . The components of the vector are found 
from the equations 

(1 — ixcC)a — ^icCb = ficC^, 



and are given by 



fj,cC 



a + {l- iicC)b = fj.cC'^ 



(2 - ncC)ficC^ 
2-4/icC + //2c2C2- 
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Prom the convergence of the sequence {{ak,bk)} it follows that the se- 
quence {"^k} converges as well. The limiting function takes the form 



Furthermore, the sequence {^k} also converges to a function given by 



It is easy to see that $ presents a distribution function of a r.v. that 
we denote by X . We note that P{X = c} > whereas c is the only single 
value the variable X can take with positive probability. 

The convergence of the distribution functions — )■ $ involves the con- 
vergence of means EX(k) EX . This leads to the conclusion that 



'C(a + 6 + C)e''*, ift<0; 
^{t) = lc{^{c-t) + b + C)et'\ ifO<i<c; 
1, ift>c. 



Substitution of the values for a and b yields 




m = Famit) = 




X= lim -V EXm = EX 

fe->oo 



i=l 



To evaluate the last expectation, we first find the probability 



p = P{X = c} = 1 




= 1 - 



C(4 - G/irC + ii^<-C- - 2C + 2/trC2) 
2 - 4/xcC + /x2c2C2 



Now we have 




Finally, substitution C = e '^'^ gives the result 



\ = c + 



2g-3MC 
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A. 2 A Matrix With Zero Row 

Consider a solution for system ^ with the matrix 



A{k) 



ttk c 





where c is a nonnegative constant, and is a nonnegative r.v. that has a 
distribution function F{t) with finite mean a. First, we represent equations 
([1]) in the form 

x{k) = max(x(/c — 1) + Ofe, y{k — 1) + c), 
y{k) = max(x(/c — l),y{k — 1)). 

By introducing a new state variable 

X{k) = x{k) -x{k - 1), 

we reduce ([T]) to one equation 

X{k) = max(Q!fc, c — X{k — 1)). 

Since x{k) > y{k) and x{k) = X{1) + • • • + X{k) , we have 

1 1 

A= lim — Emax(x(A;), = lim — > EX(A;). 

i=l 

Furthermore, we define the distribution function 

<!>k{t) = P{X{k) < t}, 

and note that 

^ , , fo, if t < 0, ^ , , fo, if t < c, 
[1, ift>0, [Fii), if t > c. 

Evaluation of the above probability for all /c > 1 gives a recursive equa- 
tion 

'O, ift<0, 
^k{t) = I F{t){l - «>fc_i(c - t)), if < t < c, 
^F{t), ift>c. 

Let us examine the equation when < t < c. After one iteration, we 
have 

^k{t) = - F(c - - ^k-2m- 

Now we define a function 

= F(t)F(c-t). 
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For all even k = 2m, by iterating the last equation, we arrive at the 
function 

^2m{t) = 1 - (1 - Fmi + G{t) + ■■■ + 

The sum on the right-hand side is actually an initial part of the geometric 
series with the common ratio G{t) < 1 . 

In the limit as m tends to infinity, for all t under consideration, the 
subsequence ^2m{t) goes to 

^ ' 1-G{t) 1-G{t) ■ 

In the same way, for all k = 2m + 1 , we get a subsequence of functions 

^2m+i{t) = F{t){l - F{c - t)){l + G{t) + ■■■ + G'^-^t)), 

and then verify that ^2m+i{t) ^(i) as m — )■ oo. 

From the convergence of the subsequences to a common limit, it follows 
that when < t < c, the entire sequence ^k{t) also converges to 

^ F{t) - G{t) ^ F(t)(l-F(c-t)) 
^ ^ l-G{t) l-F{t)F{c-t) ■ 

Taking into account that $fc(t) = F{t) if t > c, we finally conclude that 
for all t , as A: — )• oo , the sequence {^k} converges to the function 



'O, ift<0, 

F{t){l-F{c-t)) ^fr)^f<r 

l-F(t)F(c-t) ' 11 U < t S C, 

^F{t), ift>C. 



It is clear that the limiting function presents a distribution function 
for a r.v. X . 

Since X{k) converges to X in distribution, we see that EX (A;) EX 
as — )• oo , and therefore, A = EX . 

To evaluate the expected value of X , consider the integral 



By applying integration by parts to the first term, we finally get 

{c-t){l-F{ 
F{t)F{c-t) 



Jo 1 
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